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(57) ABSTRACT 

Described herein are systems and techniques for a motion 
capture system and a three-dimensional (3D) tracking system 
used to record body position and/or movements/motions and 
using the data to measure skin strain (a strain field) all along 
the body while a joint is in motion (dynamic) as well as in a 
fixed position (static). The data and technique can be used to 
quantify strains, calculate 3D contours, and derive patterns 
believed to reveal skin’s properties during natural motions. 
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SYSTEM AND METHOD FOR MEASURING 
SKIN MOVEMENT AND STRAIN AND 
RELATED TECHNIQUES 

STATEMENT REGARDING FEDERALLY 5 

SPONSORED RESEARCH 

This invention was made with government support under 
Grant No. CNS0932015 awarded by the National Science 
Foundation and under Grant Nos. NAS5-031 10 and NAS5- 10 
9805 1 awarded by NASA. The government has certain rights 
in this invention. 

CROSS REFERENCE TO RELATED 

APPLICATIONS 15 

Not Applicable. 

FIELD OF THE INVENTION 

20 

The concepts described herein relate to a system and tech- 
nique for measuring and modeling skin movement and more 
particularly to a system and technique for quantifying skin 
movement and deriving strain fields, contours and three-di- 
mensional patterns. 25 

BACKGROUND OF THE INVENTION 

As is known in the art, while there is extensive understand- 
ing of human skin properties based on active tensile testing, 30 
both in vitro and in vivo, there is little current knowledge of 
the strains experienced by skin during natural movements. 

Understanding the skin’s material properties and natural 
motion is important to help provide better understanding in a 
number of areas including: creating tissue engineering scaf- 35 
folds that integrate smoothly with little scarring; understand- 
ing skin growth; aging; and changes due to diseases. Past 
work has been completed to ascertain material property data 
of isolated skin samples with in vitro tensile testing and by 
applying external loads (pulling, twisting, indenting, and sue- 40 
tioning) and measuring the resulting deformations in vivo. 
These experimental methods are limited because the skin 
behaves differently when removed from surrounding tissues 
in vitro and in vivo techniques do not take into account the 
skin’s biaxial prestress. Because of the anisotropic behavior, 45 
it has been theorized that the skin contains lines of non- 
extension (LONEs), or contours of the skin that stay a con- 
stant length with minimal stretching capacity that only rotate 
during joint motion. As the body moves, particularly close to 
the joint, these LONEs do not always exist; in those cases the 50 
contours that are most important are those with the minimum 
extension or compression. Previous work, however, have only 
been able to qualitatively find non-extending lines. 

SUMMARY OF THE INVENTION 55 

The concepts, systems and techniques described herein 
result in a new understanding of the relationship between the 
structure of skin and the strains it experiences during natural 
joint movement. In particular, concepts, systems and tech- 60 
niques allow one to quantify strains, calculate three-dimen- 
sional (3D) contours, identify lines of non-extension 
(LONEs) and derive patterns that are believed to reveal skin’ s 
properties during natural motions . The system and techniques 
described herein may thus find application in a wide variety of 65 
areas including, but not limited to, design of tissue-engineer- 
ing scaffolds, medical diagnosis for skin surgery, the design 


and development of soft exoskeletons, as well as commercial 
spacesuits and athletic garments. 

In accordance with the concepts, systems and techniques 
described herein, a motion capture system (including a cam- 
era, video acquisition, processing and tracking markers) and 
a three-dimensional (3D) tracking system (e.g. a laser scan- 
ner) are used to record body movements/motions. By record- 
ing body movements/motions a new method is provided for 
measuring the skin’s strain all along the body (a strain field) 
while a joint is in motion (dynamic) as well as in a fixed 
position (static). Thus, while prior art techniques were able to 
qualitatively find non-extending lines, having dynamic infor- 
mation during the entire motion, allows one to quantify 
strains, calculate 3D contours, and derive patterns that are 
believed to reveal skin’s properties during natural motions. 

From motion capture or laser scan position data, a lines of 
non-extension (LONEs) processor 522 calculates lines of 
non-extension by analyzing the changes in distance between 
each marker point and its closest neighbors from initial posi- 
tion to deformation, and calculating strain values. When a 
rectangular grid (such as that shown in FIGS. 3A, 3B is used), 
closest neighbors are considered to be the two markers adja- 
cent in the same row and also the three markers in the rows 
above and below in the corresponding columns. In one 
embodiment, second order Lagrangian strains e are calcu- 
lated using the following equation (it should be noted that the 
second order equation is used because the strains are so 
large): 


l 2 -l 2 0 _M (A if 
2 /§ 


In which: 

1 is the new distance between two points 

\ a is the original length between two points, and 

A1 is the difference between the two. 

The 3D strains surrounding each data point are projected 
onto a two-dimensional (2D) plane tangent to the body skin at 
each marker position. In one exemplary embodiment, this 2D 
plane is created by first averaging the nonnal vectors to the 
planes between each neighboring pair of strain vectors. This 
new “average” nomial of (eight) 8 different planes defines the 
normal vector to the tangential plane created at the marker 
position. It should be appreciated that other techniques to 
compute the plane, may also be used. After being projected 
onto the tangential plane, the strains are then rotated in pairs 
onto the axes defined by the location of the marker directly 
above and then averaged together to give the longitudinal 
strain (e v ), the circumferential strain (€ x ), and the shear strain 
fey)- 

This is followed by eigenvector analysis to detemiine the 
principle strains (€ 7 and e /7 ). If the principle strains are of 
opposite signs, meaning there is both extension and compres- 
sion. they are used to mathematically detemiine the angle of 
the lines of non-extension (□) with the known equations: 


tan 2 0 = 


s,(2 + s,) 
-s„(2 + s,i) 


tan 2 0 = 


(1 -£,) 2 ( s ,(2 + £,)) 

(1 +e„) 2 (l -(1 +B„) 2 ) 


where the first equation is the angle between the primary 
eigenvector and the line of non-extension projected onto the 
initial position and the second equation is the same angle 
projected onto the defonned position. If the principle strains 
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are of the same sign, meaning there is only local extension or 
local compression, then the minimum extension or minimum 
compression is recorded, respectively. These angles are pro- 
jected onto the body surface (e.g., leg) and, during primarily 
stationary analysis only, they are connected to continuous 
lines (e.g. using basic spline functions). This method of find- 
ing tangent planes and creating strain tensors requires all 
eight (8) surrounding points. Other techniques may, of 
course, also be used. 

With this particular methodology, body motion and skin 
movement are provided and skin-strain field analysis and 
patteming/contours are provided. In one embodiment, the 
motion capture system measures skin movement and strain 
around the knee during a squatting motion. It should, of 
course, be appreciated that the system and techniques 
described herein above are not limited to use with any par- 
ticular body part (e.g. knee regions) or any particular motion 
(e.g. squatting), rather the system and techniques described 
herein may be used in any body region and for any body 
movement including body joint movements for dynamic 
motions (e.g., squatting, bending, walking, etc.). 

In accordance with a further aspect of the concepts 
described herein, a new technique to analyze skin movement 
and strain for a static body as well as a body in motion (e.g. 
around the knee during a squatting motion) includes calcula- 
tions of lines of non-extension, minimum and maximum skin 
movement, compression and tension. 

In accordance with a further aspect of the concepts, sys- 
tems and techniques described herein, a method for manufac- 
turing a garment (e.g. an athletic garment, a spacesuit, etc. . . 

. ) comprises using a material formed into a shape by at least 
considering lines of non-extension of the body part over 
which the garment will be disposed wherein the lines of 
non-extension of the body part are determined, at least in part, 
from position data of body skin of the body part wherein the 
position data is generated from a plurality of position data 
points obtained at one or more locations defined by one or 
more corresponding markers disposed on the body skin 
wherein the position data is computed using an initial position 
and a deformed position and computing lines of non-exten- 
sion from the position data measure at least at the initial 
position and a deformed position. 

Thus, in accordance with a further aspect of the concepts, 
systems and techniques described herein, a method for design 
of tissue-engineering scaffolds comprises forming tissue-en- 
gineered scaffolds into a shape by at least considering lines of 
non-extension of the body part over which the tissue-engi- 
neered scaffolds will be disposed wherein the lines of non- 
extension of the body part are determined, at least in part, 
from position data of body skin of the body part wherein the 
position data is generated from a plurality of position data 
points obtained at one or more locations defined by one or 
more corresponding markers disposed on the body skin 
wherein the position data is computed using an initial position 
and a deformed position and computing lines of non-exten- 
sion from the position data measure at least at the initial 
position and a deformed position. 

Thus, in accordance with a further aspect of the concepts, 
systems and techniques described herein, a method for soft 
exoskeletons comprises forming a soft exoskeleton into a 
shape by at least considering lines of non-extension of the 
body part over which the tissue-engineered scaffolds will be 
disposed wherein the lines of non-extension of the body part 
are determined, at least in part, from position data of body 
skin of the body part wherein the position data is generated 
from a plurality of position data points obtained at one or 
more locations defined by one or more corresponding mark- 


4 

ers disposed on the body skin wherein the position data is 
computed using an initial position and a deformed position 
and computing lines of non-extension from the position data 
measure at least at the initial position and a deformed posi- 
5 tion. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The foregoing features of the concepts, systems, circuits 
10 and techniques described herein may be more fully under- 
stood from the following description of the drawings in 
which: 

FIG. 1A is a graphical representation of lines of non- 
extension; 

15 

FIGS. 1B-1D illustrate three (3) cases of a deformation 
ellipse. The circle outlined in completed (i.e. solid) lines 
represents to initial position and the circle with dotted lines 
represents the deformed position. Case 1 (FIG. IB): LONES 
, 0 exist. Case 2 (FIG. 1C) — complete extension: the important 
direction is the line of minimum extension. Case 3 (FIG. 
ID) — complete compression: the important direction is the 
line of minimum compression; 

FIGS. 2A and 2B are a series of flow diagrams that illus- 
25 trate a process for recording body positions and movements/ 
motions for measuring skin strain along a body (a strain field) 
while a joint is in motion (dynamic) as well as in a fixed 
position (static); 

FIGS. 3A and 3B illustrate exemplary placement of one 
30 hundred forty four (144) four 4 millimeter (nun) and 6 mm 
infrared reflecting, spherical markers on a right leg. FIG. 3A 
is the anterior of the leg and FIG. 3B is the posterior of the 
right leg; 

FIGS. 4A and 413 are a graphical explanation of how strain 
35 pairs are rotated onto the new axes defined by the position of 
the marker directly above; 

FIG. 5A illustrates a motion capture reconstruction of 
reflective markers on a bent leg; 

FIG. 5B is a map of longitudinal strains that occur as the leg 
40 moves from extended to flexed; 

FIG. 5C shows a pattern of lines of non-extension calcu- 
lated from the strain field seen in FIG. 4B; 

FIG. 6 is a block diagram of a system for measuring and 
modeling skin movement and for quantifying skin movement 
45 and deriving strain fields, contours and three-dimensional 
patterns; and 

FIG. 7 is a block diagram of a processor of the type which 
may be used in the system of FIG. 6. 

50 DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

Referring now to FIG. 1A, a graphical representation of 
lines of non-extension includes a reference circle 10, a defor- 
55 mation circle 12, a line of maximum extension 14, a line of 
maximum contraction 16, and two lines of non-extension 
portions 18a, 186 of which illustrate diameters that belong to 
both the circle and the ellipse. 

Referring now to FIGS. 1B-1D, three (3) cases of a defor- 
60 mation ellipse are shown. The circle outlined in completed 
(i.e. solid) lines 20 represents an initial position and the circle 
with dashed lines 22 represents a deformed position. As vis- 
ible in FIG. IB, (i.e. Case 1 ) lines of non-extension (LONES) 
exist. 

65 Referring now to FIG. 10, as with FIG. IB, the circle 
outlined in completed (i.e. solid) lines 24 represents an initial 
position and the circle with dashed lines 26 represents a 
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deformed position. As visible in FIG. 1C (i.e. Case 2 — com- 
plete extension) the important direction is the line of mini- 
mum extension. 

Referring now to FIG. ID, as with FIGS. IB and 1C, the 
circle outlined in completed (i.e. sold) lines 28 represents an 5 
initial position and the circle with dashed lines 29 represents 
a deformed position. As visible in FIG. 10 (Case 3 — complete 
compression) the important direction is the line of minimum 
compression. 

Referring now to FIGS. 2A and 2B, a process for measur- 10 
ing the skin’s strain all along the body (a strain field) while a 
joint is in motion (dynamic) as well as in a fixed position 
(static) begins by placing markers on a body (or a portion of 
a body) under test to mark the points at which data will be 
obtained as shown in block 30. One particular example of 15 
marker placement on a knee is described in detail below in 
conjunction with FIGS. 3A, 3B. It should, of course, be 
appreciated that the particular placement of markers depends 
upon a variety of factors including, but not limited to, the 
portion of the body being measured (e.g. knee, elbow, etc. . . 20 
. ), and the limitations of the tracking system. 

As shown in block 32, once the markers are placed such 
that acceptable data can be obtained, a measurement system 
obtains data at each marker position. In one exemplary 
embodiment, the measurement system includes a motion cap- 25 
ture system (including, for example, a camera, video acqui- 
sition, processing and tracking markers) and a three-dimen- 
sional (3D) tracking system (e.g. a laser scanner) which 
record body positions and movements/motions (i.e. measure- 
ment are made while the body (or body portion — e.g. joint) is 30 
in motion (dynamic) as well as in a fixed position (static ). One 
exemplary system is described below in conjunction with 
FIG. 6. 

Once the data is collected, as shown in block 34, 3D strain 
values are computed for each point. In one embodiment, 35 
second order Lagrangian strains e are calculated using the 
following equation: 


P-ll M (A /) 2 4U 

111 ~ l o + 2/5 ' 

In which: 

1 is the new distance between two points 45 

\ 0 is the original length between two points, and 
A1 is the difference between the two. 

Processing then proceeds to processing block 36 in which 
a two-dimensional (2D) plane tangent to the body skin at each 
marker position is computed. In one embodiment, the two- 50 
dimensional (2D) plane is created by first averaging the nor- 
mal vectors to the planes between each neighboring pair of 
strain vectors. This new “average” normal of eight (8) differ- 
ent planes defines the normal vector to the tangential plane 
created at the marker position. It should be appreciated that 55 
other techniques may also be used to compute this plane. 
However, it is believed that this technique yields the most 
accurate results if a measurement system of the type 
described below in conjunction with FIG. 6 is used. 

Once the two-dimensional (2D) plane tangent to the body 60 
skin at each marker position is computed, the 3D strains are 
projected onto the 2D tangent planes as shown in block 38. 

Next, as shown in blocks 40 and 42, longitudinal strain (e v ), 
the circumferential strain (e x ), and the shear strain (e^.) are 
computed (see FIGS. 4A, 4B). In one embodiment, this is 65 
accomplished in the following manner. After the 3D strains 
are projected onto the tangential plane (processing block 38), 


the strains are then rotated in pairs onto the axes defined by the 
location of the marker directly above (as illustrated in FIGS. 
4A and 4B below) and then averaged together to give the 
longitudinal strain (€ r ), the circumferential strain (e x ), and the 
shear strain (e ). 

Also, as shown in processing block 44, the principle strains 
(€ 7 and e 77 ) are determined. In one embodiment, this is accom- 
plished via an eigenvector analysis to determine the principle 
strains (€ 7 and e 77 ). 

As shown in decision block 46, if the principle strains are of 
opposite signs, meaning there is both extension and compres- 
sion, they are used to mathematically determine the angle of 
the lines of non-extension (i|)) as shown in block 48. In one 
embodiment this can be accomplished with the equations: 


e,(2 + e/) 2 (1 -e,) : (e/(2 + 

tan © = — 

Sll(2 + Sll) (1 +£//)*(! -(1 +£//) 2 


where the first equation is the angle between the primary 
eigenvector and the line of non-extension projected onto the 
initial position and the second equation is the same angle 
projected onto the defonned position. 

Processing then flows to block 50, in which these angles are 
projected onto the body surface (e.g., leg). 

Processing then flows to decision block 52. If decision 
block 52 indicates that stationary analysis should be per- 
formed (i.e. only a single frame from the imaging system is 
being processed) then processing proceeds to block 54 and, 
during stationary analysis, the angles are connected to con- 
tinuous lines (i.e. contours) using basic spline functions. It 
should be noted that techniques other than spline functions 
can also be used to connect to the continuous lines (including 
but not limited to two straight lines, etc). To date, however, it 
has been found that a spline is the smoothest and simplest 
technique. It should also be noted that the above-described 
method of finding tangent planes and creating strain tensors 
requires all eight (8) surrounding points. Processing then 
ends. 

If, on the other hand, a decision is made in decision block 
46 that the principle strains are of the same sign, meaning 
there is only local extension or local compression, then the 
minimum extension or minimum compression is recorded, 
respectively, as shown in block 49. Processing then flows to 
decision block 52 and to appropriate ones of blocks 54, 56 as 
described above. If decision block 52 indicates that motion 
analysis should be performed (i.e. the imaging system pro- 
duces multiple frames to capture motion of a body part), then 
processing flows to decision block 56 which implements a 
loop in which the process from blocks 34 to 56 is repeated 
until all frames are processed. Once all frames are processed, 
then processing ends. 

Referring now to FIGS. 3A and 3B, a body part has a 
plurality of exemplary reflecting, spherical markers, gener- 
ally denoted 60, disposed thereon. In this exemplary embodi- 
ment, the body part is a right leg having one hundred and 
forty-four (144) markers 50 disposed thereon. It should be 
noted that FIG. 3A shows the anterior of the leg and FIG. 3B 
shows the posterior of the right leg. 

Also, in this exemplary embodiment, the markers are pro- 
vided as four millimeter (4 nun) and six (6) nun infrared 
reflecting, spherical markers. It should, of course, be appre- 
ciated that other types, sizes and shapes of markers may be 
used. In short, any marker which allows the collection of data 
suitable for use in the processing described herein may be 
used. 
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Referring now to FIGS. 4 A and 4B, a graphical explanation 
is shown of how strain pairs are rotated onto the new axes 
defined by the position of the marker directly above. Eight 
points 68n-68/? are used. It should be noted that the point 
corresponding to e 270 is not used because its similarity to e y 5 
causes large error. The strain values € xy and e x are averaged for 
the final results. 

FIG. 5A illustrates a motion capture reconstruction of 
reflective markers on a bent leg. The left-most column 401 10 
indicates the anterior of the leg. 

FIG. 5B is a map of longitudinal strains that occur as the leg 
moves from an extended position to a flexed position. 

FIG. 5C shows a pattern of lines of non-extension calcu- 
lated from the strain field seen in FIG. 5B. Two lines 410, 412 
consistent with the pattern on the posterior of the knee are 
highlighted. 

Referring now to FIG. 6 a system 500 for measuring and 
modeling skin movement and for quantifying skin movement 20 
and deriving strain fields, contours and three-dimensional 
patterns includes a data collection system 510 which collects 
data from an appropriately marked body under test 512. Sys- 
tem 500 is appropriate, for example, to perform the measure- 
ment and data processing techniques described herein. 23 

Significantly, data collection system collects from the body 
under test while the body is at rest (i.e. static data collection) 
and while the body is undergoing a motion (i.e. dynamic data 
collection). It should be appreciated that body under test 512 30 
is here shown in phantom since it is not properly a part of the 
system 500 for measuring and modeling skin movement and 
for quantifying skin movement and deriving strain fields, 
contours and three-dimensional patterns. 

Data collection system 510 provides the data to a process- 35 
ing system 514 which processes the data to model and quan- 
tity skin movement and to derive strain fields, contours and 
three-dimensional patterns in accordance with the techniques 
described hereinabove. 

40 

In the exemplary embodiment of FIG. 5, data collection 
system 510 includes a motion capture system 516 and a 
tracking system 518 which may be provided for example as a 
three-dimensional laser tracker system. In one embodiment, 
motion capture system 516 is provided as an eight camera 45 
Vicon (Centennial, Colo.) motion capture system. 

Motion capture system 510 collects or otherwise obtains 
position data at the locations of the marker points as discussed 
above in conjunction with FIGS. 3A, 3B. Data collection _ n 
system 510 provides the data to processing system 514 and in 
particular to a data store 520 of processing system 514. Pro- 
cessing system 514 further includes a lines of non-extension 
(LONEs) processor 522, a principle strain processor 524 and 
a three-dimensional pattern processor 526 all of which are 55 
coupled to receive (either directly or indirectly) data from the 
data store. 

LONEs processor 522 analyzes changes in distance 
between position data at each marker point and its closest 
neighbors from initial position to deformation. When a rect- 60 
angular grid (such as that shown in FIGS. 3A, 3B is used), 
closest neighbors are considered to be the two markers adja- 
cent in the same row and also the three markers in the rows 
above and below in the corresponding columns. In one 
embodiment, because the strains are so large, LONEs proces- 65 
sor 522 calculates second order Lagrangian strains using the 
following equation: 


/ 2 — /g _ A/ (A /) 2 

2/g ~ fo" + _ 2/p 


In which: 

1 is the new distance between two points; 

\ a is the original length between two points; and 
A1 is the difference between the two; 

LONEs processor 522 then projects the 3D strains sur- 
rounding each data point onto a two-dimensional (2D) plane 
tangent to the body skin at each marker position. The 2D 
plane is created by first averaging the normal vectors to the 
planes between each neighboring pair of strain vectors 
wherein the new average normal of eight (8) different planes 
defines the normal vector to the tangential plane created at the 
marker position. After being projected onto the tangential 
plane the strains are then rotated in pairs onto the axes defined 
by the location of the marker directly above (as described 
above in conjunction with FIGS. 4 A and 4B) and then aver- 
aged together to give the longitudinal strain (e v ), the circum- 
ferential strain (e x ), and the shear strain (e ). 

Principle strain processor 524 performs an eigenvector 
analysis to determine the principle strains (e 7 and e 77 ). In 
response to the principle strains being of opposite signs, 
meaning there is both extension and compression, they are 
used to mathematically determine the angle of the lines of 
non-extension <j> with the known equations: 


£i{2+Si) _ (1 -s;) 2 (s;(2 + c 

£»(2 + £») (1 + e») 2 (l -(1 + £n) 2 . 


where the first equation is the angle between the primary 
eigenvector and the line of non-extension projected onto the 
initial position and the second equation is the same angle 
projected onto the deformed position. 

In response to the principle strains having the same sign, 
meaning there is only local extension or local compression, 
then processor 524 records the minimum extension or mini- 
mum compression and projects these angles onto the body 
surface and, during primarily stationary analysis only, con- 
nects them to continuous lines. This may be accomplished, 
for example, using basic spline functions. This exemplary 
method of finding tangent planes and creating strain tensors 
requires all (eight) 8 surrounding points. It should of course 
be appreciated that in some embodiments less than eight (8) 
points can be used. In the exemplary embodiment described 
herein, the eight (8) points (e.g. as illustrated in FIGS. 4A, 
4B) are in close proximity and increasing the number of 
(close) points increases the accuracy of the measurement. 

In one embodiment, with respect to stationary data collec- 
tion, the motion capture system was able to accurately capture 
a grid of markers spaced approximately 3 cm apart (e.g. as 
shown in FIG. 5A). Preliminary analysis identified maximum 
longitudinal strains less than 0.40, within the physical limi- 
tations of skin, in an appropriate distribution (FIG. 5B). The 
process for calculating lines of non-extension from the strain 
field data (e.g. as described in conjunction with FIGS. 2A, 2B 
above) found a pattern of lines of non-extension as shown in 
FIG. 5C. 

The entire range of strain (maximum and minimum of the 
total strain), longitudinal strain, circumferential strain, and 
sheer strain for each data point are found. 

A three-dimensional pattern processor 526 processes the 
data provided thereto to connect the calculated angles from 
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LONES processor 522 from each data point into anatomically 
feasible contours. In this way, the system is capable of gen- 
erating designs for flexible apparel. Such apparel includes but 
is not limited to athletic or other clothing, portions of space 
suits and in particular. The system is also useful for generating 5 
designs of tissue-engineering scaffolds, medical diagnosis 
for skin surgery and the design and development of soft 
exoskeletons. 

In one exemplary embodiment the above described tech- 
nique was utilized on a knee. In this exemplary embodiment, to 
an eight camera Vicon (Centennial, Colo.) motion capture 
system was used to track one hundred forty four (144) 4-mm 
and 6-mm spherical reflective markers positioned approxi- 
mately 3 cm apart around a healthy adult female knee joint 
with care taken to make a grid with the markers aligned in 15 
rows and columns (see FIGS. 3A, 3B). In the exemplary 
embodiment shown in FIGS . 3 A, 3B the markers are disposed 
in a substantially rectangular grid pattern. Other patterns 
(both grid and non-grid patterns — e.g. lattice patterns) may, 
of course, also be used. In preferred embodiments, the mark- 20 
ers are disposed in a uniform grid pattern. Such a grid pattern 
facilitates use of nearest neighbor computations. It should 
also be appreciated that the distance between markers 
impacts the accuracy of anatomical representations and the 
ability to make physiological implications. Thus, the closer 25 
the spacing of the markers, the more accurate the anatomical 
representation and the greater the ability to make physiologi- 
cal implications based upon the anatomical representation. 

Of course, by spacing markers more closely in a given area 
(e.g. 1 cm spacing or less), the larger the number of data 30 
points which will be generated and consequently the more 
time it takes to perform computations. Thus, a trade-off may 
be made between the amount of data needed and the time 
required to measure and process the data. In one embodiment, 
the resolution of the motion capture system is the limiting 35 
factor in selecting spacing between markers. 

With the markers are properly positioned, stationary (i.e. 
static) data collection is performed. Position data is captured 
by the motion capture system with the body joint (e.g., knee) 
extended (initial position) and then again with the body joint 40 
flexed (final position). 

The acquired position data is filtered and averaged so there 
is one position for each marker in each position, which then 
serves as input to the analysis/calculations methodology 
described above. 45 

Also, with the markers properly positioned, motion (i.e. 
dynamic) data collection can be performed. It should be noted 
that the same body marker grid should be used in both the 
stationary (i.e. static) data collection and the motion (dy- 
namic) data collection. Motion capture position data are col- 50 
lected for an entire flexion and extension cycle (-6 seconds) 
for the entire movement for every/any body joint. In the 
dynamic case (e.g. 2-6 seconds of movement captured at a 
rate of about 15-30 frames per second), an analysis program 
compares each frame to the initial position (first frame). The 55 
resultant output is strain data for each point that can be com- 
bined and analyzed over time or for the duration of the move- 
ment. Significantly, the system also can be used to produce 
video files to display the strain and directions of the non- 
extending lines graphically on a 3D reconstruction of the 60 
body (e.g., leg). 

Tlie technique described herein allows new data to be gen- 
erated and with this new data, one can calculate the lines of 
non-extension, or contours of the skin that remain a constant 
length during motion as described herein above. 65 

Tlie system and techniques described herein result in a new 
understanding of the relationship between the structure of 
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skin and the strains it experiences during natural joint move- 
ment. The system and techniques described herein may find 
application in a wide variety of areas including, but not lim- 
ited to, design of tissue-engineering scaffolds, medical diag- 
nosis for skin surgery, the design and development of soft 
exoskeletons, commercial spacesuits and athletic garments. 

It should also be appreciated that the above-described tech- 
niques can be used to calculate the angle of the line of non- 
extension, line of minimum extension, or line of minimum 
compression for each frame. 

Referring now to FIG. 7, a computer 752 suitable for sup- 
porting the operation of an embodiment of the inventive sys- 
tems, concepts, and techniques described herein includes a 
processor 754. Processor 754 may, for example, be provided 
as a dual-core processor, such as one of the types available 
from the Advanced Micro Devices Corporation of from Intel 
Corporation. However, it should be understood that computer 
752 may use other microprocessors. Computer 752 can rep- 
resent any server, personal computer, laptop, or even a bat- 
tery-powered mobile device such as a hand-held personal 
computer, personal digital assistant, or smart phone. 

Computer 752 includes a system memory 756 which is 
connected to the processor 754 by a system data/address bus 
762. System memory 756 includes a read-only memory 
(ROM) 758 and random access memory (RAM) 760. The 
ROM 758 represents any device that is primarily read-only 
including electrically erasable programmable read-only 
memory (EEPROM), flash memory, etc. RAM 760 represents 
any random access memory such as Synchronous Dynamic 
Random Access Memory (SDRAM). The Basic Input/Output 
System (BIOS) 196 for the computer 752 is stored in ROM 
758 and loaded into RAM 760 upon booting. 

Within the computer 752, input/output (I/O) bus 764 is 
connected to the data/address bus 762 via a bus controller 
766. In one embodiment, the I/O bus 764 is implemented as a 
Peripheral Component Interconnect (PCI) bus. The bus con- 
troller 766 examines all signals from the processor 754 to 
route signals to the appropriate bus. Signals between proces- 
sor 754 and the system memory 756 are passed through the 
bus controller 766. However, signals from the processor 754 
intended for devices other than system memory 756 are 
routed to the I/O bus 764. 

Various devices are comiected to the I/O bus 764 including 
internal hard drive 768 and removable storage drive 770 such 
as a CD-ROM drive used to read a compact disk 771 or a 
floppy drive used to read a floppy disk. The internal hard drive 
768 is used to store data, such as in files 774 and database 776. 
Database 776 may include, for example, a structured collec- 
tion of data, such as a relational database. A display 772, such 
as a cathode ray tube (CRT), liquid-crystal display (LCD), 
etc. is connected to the I/O bus 764 via a video adapter 778. 

A user enters commands and information into the com- 
puter 752 by using input devices 780, such as a keyboard and 
a mouse, which are comiected to I/O bus 764 via I/O ports 
781 . Other types of pointing devices that may be used include 
track balls, joy sticks, and tracking devices suitable for posi- 
tioning a cursor on a display screen of the display 772. 

Computer 752 may include a network interface 786 to 
connect to a remote computer 782, an intranet, or the Internet 
via network 784. The network 784 may be a local area net- 
work or any other suitable co mmu nications network. Data 
from external systems (e.g. a data collection system such as 
that described above in conjunction with FIG. 6) may be 
provided tom computer 752 through various computer I/O 
ports and/or network connections. 

Computer-readable modules and applications 788 and 
other data are typically stored on memory storage devices, 
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which may include the internal hard drive 768 or the compact 
disk 771, and are copied to the RAM 760 from the memory 
storage devices. In one embodiment, computer-readable 
modules and applications 788 are stored in ROM 758 and 
copied to RAM 760 for execution, or are directly executed 
from ROM 758. In still another embodiment, the computer- 
readable modules and applications 788 are stored on external 
storage devices, for example, a hard drive of an external 
server computer, and delivered electronically from the exter- 
nal storage devices via network 784. 

The computer-readable modules 788 may include com- 
piled (or compilable) instructions for implementing embodi- 
ments of one or more of: a LONEs processor, a principle 
strains processor or a skin orientation processor and methods 
described herein. Skin movement and/or strain data may be 
rendered and outputted to display 772 to enable users to 
graphically view the data (e.g. as shown in FIGS. 3A-5C). 

In a further embodiment, the computer 752 may execute 
various processes on separate processors, such as a first pro- 
cessor and a second processor of a dual core processor. As by 
way of a non-limiting example, control of data collections 
operations (e.g. to receive and respond to data from a data 
collection system) may be executed by the first processor and 
skin and strain operations (e.g., to compute LONEs and strain 
values) may be executed by the second processor. Alterna- 
tively, the first and second processors may be respective first 
and second computing devices. 

The computer 752 may execute a database application 790, 
such as Oracle™ database from Oracle Corporation, to 
model, organize, and query data stored in database 776. The 
data may be used by the computer-readable modules and 
applications 788 and/or passed over the network 784 to the 
remote computer 782 and other systems. 

In general, the operating system 792 executes computer- 
readable modules and applications 788 and carries out 
instructions issued by the user. For example, when the user 
wants to execute a computer-readable module 788, the oper- 
ating system 792 interprets the instruction and causes the 
processor 754 to load the computer-readable module 788 into 
RAM 760 from memory storage devices. Once the computer- 
readable module 788 is loaded into RAM 760, the processor 
754 can use the computer-readable module 788 to carry out 
various instructions. The processor 754 may also load por- 
tions of computer-readable modules and applications 788 
into RAM 760 as needed. The operating system 792 uses 
device drivers 794 to interface with various devices, including 
memory storage devices, such as hard drive 768 and remov- 
able storage drive 770, network interface 786, I/O ports 781, 
video adapter 778, and printers. 

It should be appreciated that the processes described herein 
(e.g. in conjunction with FIGS. 2A and 2B, for example) are 
not limited to use with the hardware and software of FIG. 7. 
Rather, they may find applicability in any computing or pro- 
cessing environment and with any type of machine or set of 
machines that is capable of running a computer program. 

It should also be appreciated that the processes described 
herein (e.g. in conjunction with FIGS. 2A and 2B, for 
example) may be implemented in hardware, software, or a 
combination of the two. The processes described herein may 
be implemented in computer programs executed on program- 
mable computers/machines that each includes a processor, a 
storage medium or other article of manufacture that is read- 
able by the processor (including volatile and non-volatile 
memory and/or storage elements), at least one input device, 
and one or more output devices. Program code may be applied 
to data entered using an input device to perform one or more 
of the processes and/or to generate output information. 
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The system may be implemented, at least in part, via a 
computer program product, (e.g., in a machine-readable stor- 
age device), for execution by, or to control the operation of, 
data processing apparatus (e.g., a programmable processor, a 
5 computer, or multiple computers)). Each such program may 
be implemented in a high level procedural or object-oriented 
progra mmin g language to communicate with a computer sys- 
tem. However, the programs may be implemented in assem- 
bly or machine language. The language may be a compiled or 
to an interpreted language and it may be deployed in any form, 
including as a stand-alone program or as a module, compo- 
nent, subroutine, or other unit suitable for use in a computing 
environment. A computer program may be deployed to be 
executed on one computer or on multiple computers at one 
15 site or distributed across multiple sites and interconnected by 
a communication network. A computer program may be 
stored on a storage medium or device (e.g., CD-ROM, hard 
disk, or magnetic diskette) that is readable by a general or 
special purpose programmable computer for configuring and 
20 operating the computer when the storage medium or device is 
read by the computer to perform processes. The processes 
described herein may also be implemented as a machine- 
readable storage medium, configured with a computer pro- 
gram, where upon execution, instructions in the computer 
25 program cause the computer to operate in accordance with 
processes. 

The processes described herein are not limited to the spe- 
cific embodiments described. For example, the process 
described in FIGS. 2 A and 2B are not limited to the specific 
30 processing order shown in FIGS. 2A and 2B, respectively. 
Rather, unless otherwise precluded, any of the processing 
blocks of FIGS. 2A and 2B may be re-ordered, combined or 
removed, perfomted in parallel or in serial, as necessary, to 
achieve the results set forth above. 

35 The processing described herein (e.g. in conjunction with 
FIGS. 2A, 2B) associated with implementing the system and/ 
or the techniques described herein may be performed by one 
or more programmable processors executing one or more 
computer programs to perform the functions of the system. 
40 All or part of the system may be implemented as, special 
purpose logic circuitry (e.g., an FPGA (field programmable 
gate array) and/or an ASIC (application-specific integrated 
circuit)) and/or neural networks. 

Also, it should be appreciated that elements of different 
45 embodiments described herein may be combined to form 
other embodiments not specifically set forth above. Other 
embodiments not specifically described herein are also within 
the scope of the following claims. 

Having described preferred embodiments of the concepts, 
50 systems, circuits and techniques described herein, it will now 
become apparent to those of ordinary skill in the art that other 
embodiments incorporating these concepts may be used. For 
example, it should now be appreciated that one can apply the 
topologies described herein to rectifier systems (e.g. for grid- 
55 connected power supplies) as well and for bidirectional 
power flow converter systems. Accordingly, it is submitted 
that that the concepts, systems, circuits and techniques 
described herein, should not be limited to the described 
embodiments but rather should be limited only by the spirit 
60 and scope of the appended claims. 

The invention claimed is: 

1 . A system to measure skin movement and strain on a body 
under test, the system comprising: 

a data collection system which collects data from the body 
65 under test wherein the data collection system is adapted 

to collect data from the body under test while the body is 
at rest and while the body is undergoing a motion; 
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a processing system coupled to receive data from said data 
collection system, said processing system for processing 
the data to model and quantify skin movement and to 
derive strain fields, contours and three-dimensional pat- 
terns of skin on the body under test; 5 

wherein said data collection system comprises: 

a motion capture system which obtains position data at 
locations identified by a plurality of markers disposed 
on the surface of the skin of the body under test; and 
a tracking system corresponding to a three-dimensional laser 1 0 
tracker system wherein said processing system comprises a 
lines of non-extension (LONEs) processor coupled to receive 
data from said data collection system and to analyze changes 
in distance between position data at each marker point and its f 5 
closest neighbors from initial position to deformation; 
wherein said LONEs processor calculates second order 
Lagrangian strains in accordance with: 

20 

_l 2 -l\ _M (M ) 2 

2 1 2 0 “ + ~2/p 


In which: 

1 is the new distance between two points; 23 

1 0 is the original length between two points; and 

D1 is the difference between the two. 

2. The system of claim 1 wherein said LONEs processor 
projects 3D strains surrounding each data point onto a two- 
dimensional (2D) plane tangent to the body skin at each 30 
marker position. 

3. The system of claim 2 wherein after being projected onto 
the tangential plane, said LONEs processor rotates the strains 
in pairs onto the axes defined by a location of a marker 
directly above and then averaged together to provide a longi- 35 
tudinal strain value (z y ), a circumferential strain value (e T ), 
and a shear strain value (e xy ). 

4. The system of claim 3 wherein said principle strain 
processor performs an eigenvector analysis to determine the 
principle strains ( e 7 and e 77 ) wherein In response to the prin- 40 
ciple strains being of opposite signs, using the principle 
strains (e 7 and e 77 ) to determine the angle of the lines of 
non-extension. 

5 . The system of claim 4 wherein In response to the prin- 
ciple strains being of opposite signs, said principle strain 43 
processor uses the principle strains (e 7 and e 77 ) to mathemati- 
cally determine the angle of the lines of non-extension with 
the known equations: 


50 


tan 2 0 = 


g/(2 + e,) 
-Sll(2+Sn) 


tan 2 (fi = 


(1 -g/) 2 (g/(2 +g/)) 

(1 +£,,) 2 (1 -(1 +£/|) 2 ) 


where the first equation is the angle between the primary 55 
eigenvector and the line of non-extension projected onto the 
initial position and the second equation is the same angle 
projected onto the deformed position. 

6. A method for computing lines of non-extension com- 
prising: 60 

(a) obtaining position data using a motion capture system, 
wherein obtaining position data comprises obtaining 
three-dimensional (3D) positions of a plurality of 
marker points disposed on body skin surrounding a joint 
of a test subject, wherein obtaining 3D positions of the 65 
plurality of marker points includes obtaining 3D posi- 
tions of the marker points with the joint of the test 


subject in an initial position, moving the joint of the test 
subject to a deformed position, and obtaining 3D posi- 
tions of the marker points with the joint of the test 
subject in the deformed position, wherein the plurality of 
marker points form a rectangular grid on the body skin of 
the test subject; 

(b) analyzing changes in distance between each marker 
point and that marker point’s closest neighbors from the 
initial position to the deformed position, wherein the 
closest neighbors include adjacent marker points in the 
same row of the rectangular grid, adjacent marker points 
in the same column of the rectangular grid, and adjacent 
marker points disposed diagonally in the rectangular 
grid; 

(c) determining one or more 3D strains surrounding each 
marker point, wherein determining one or more 3D 
strains includes calculating second order Lagrangian 
strains; 

(d) projecting 3D strains surrounding each marker point 
onto a two-dimensional (2D) plane tangent to the body 
skin at the corresponding marker point; 

(e) after projecting 3D strains onto the 2D tangential plane 
for each marker point, rotating the projected strains in 
pairs onto axes defined with respect to the location of the 
corresponding marker point; 

(f) averaging the rotated pairs for each axis associated with 
each marker point to generate a longitudinal strain (€ y ), 
a circumferential strain (€„), and a shear strain (e x>1 ); 

(g) determining principle strains (e 7 and «//) for each 
marker point; 

(h) if the principle strains associated with a first marker 
point have opposite signs, determining an angle of a line 
of non-extension for the first marker point using the 
principle strains associated with the first marker point; 

(i) if the principle strains associated with the first marker 
point have the same sign, recording an angle of mini- 
mum extension or minimum compression for the first 
marker point and projecting the angle of minimum 
extension or minimum compression onto the body sur- 
face. 

7. The method of claim 6 further comprising: 

repeating (h) and (i) for other marker points in the plurality 

of marker points; and 

connecting angles of lines of non-extension into contours. 

8. The method of claim 6 wherein: 

obtaining three dimensional positions of the marker points 
includes obtaining three dimensional positions of the 
marker points with the joint of the test subject in posi- 
tions other than the initial position and the deformed 
position as part of a motion analysis; and 

repeating (b) through (i) for successive frames of the 
motion analysis. 

9. The method of claim 6 wherein calculating second order 
Lagrangian strains includes using the following equation: 


l 2 -l 2 0 _\l (AO 2 

2 % 


In which: 

e is the second order Lagrangian strain for two points; 

1 is a new distance between the two points; 

1 0 is an original distance between the two points; and 
A1 is a difference between the new distance and the 
original distance. 
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10. The method of claim 6 wherein determining an angle of 
a line of non-extension for the first marker point using the 
principle strains associated with the first marker point 
includes using the equations: 


tan 2 0 = 


£>(2 + £ f ) 

— £// (2 + £//) 


tan 2 0 = 


(l-£,) 2 (£,(2+£,P 

(l+£„) 2 (l-(l+£„) 2 ) 


wherein the equations correspond to the angle between a 
primary eigenvector and the line of non-extension projected 
onto the initial position and the deformed position, respec- 
tively, wherein e 7 and e 77 are the principle strains. 

11. The method of claim 6 further comprising: generating 
the 2D tangential plane for each marker point, before project- 
ing the 3D strains, by averaging normal vectors to the planes 
between each neighboring pair of strain vectors associated 
with the corresponding marker point, wherein a neighboring 
pair of strain vectors comprises strain vectors associated with 
two closest neighbor marker points that are adjacent to one 
another. 

12. The method of claim 11 wherein averaging normal 
vectors includes averaging normal vectors associated with 
eight (8) different planes. 

13. The method of claim 6 wherein determining the prin- 
ciple strains (e 7 and «//) comprises performing an eigenvector 
analysis to determine the principle strains (e 7 and e 77 ). 

14. A method to measure movement and strain, the method 
comprising: 

(a) obtaining position data associated with body skin of a 
test subject using a motion capture system, the position 
data corresponding to a plurality of marker points dis- 
posed on the body skin around a joint of the test subject, 
wherein obtaining position data includes obtaining posi- 
tion data for multiple different orientations of the joint of 
the test subject; 

(b) computing angles of lines of non-extension for various 
marker points on the body skin of the test subject using 
the collected position data wherein computing angles of 
lines of non-extension includes; 

(bl) determining one or more three-dimensional (3D) 
strains surrounding each marker point; 

(b2) computing a two-dimensional (2D) plane tangent to 
the body skin at each marker point at which position data 
of body skin was taken in (a); 

(b3) projecting the 3D strains surrounding each marker 
point onto the corresponding 2D plane tangent to the 
body skin; 

(b4) computing values for longitudinal strain (e v ), circum- 
ferential strain (ej, and shear strain (e TV ) for each marker 
point; 

(b5) determining principle strains (e 7 and e 77 ) for each 
marker point; 

(b6) if the principle strains associated with a first marker 
point have opposite signs, using the principle strains to 
mathematically determine an angle of a line of non- 
extension for the first marker point; 

(b7) repeating (b6) for other marker points within the plu- 
rality of marker points; and 

(c) connecting the angles of lines of non-extension into 
contours for use in performing at least one of: flexible 
apparel design, tissue-engineering scaffold design, soft 
exoskeleton design, and skin surgery. 

15. The method of claim 14 further comprising if the prin- 
ciple strains associated with the first marker point have a 


common sign, recording an angle of minimum compression 
or minimum extension for the first marker point. 

16. The method of claim 14 further comprising projecting 
strains onto the surface for analysis. 

5 17. A method to measure skin movement and strain, the 

method comprising: 

(a) obtaining position data of body skin using a motion 
capture system, wherein obtaining position data com- 
prises obtaining three dimensional (3D) positions of a 
plurality of marker points disposed on the body skin 
surrounding a joint of a test subject, wherein obtaining 
3D positions of the plurality of marker points includes 
obtaining 3D positions of the marker points with the 

! . joint of the test subject in an initial position, moving the 
joint of the test subject to a deformed position, and 
obtaining 3D positions of the marker points with the 
joint of the test subject in the deformed position, wherein 
the plurality of marker points form a rectangular grid on 

20 the body skin of the test subject; 

(b) analyzing changes in distance between each marker 
point and that marker point’s closest neighbors from the 
initial position to the deformed position, wherein the 
closest neighbors include adjacent marker points in the 

25 same row of the rectangular grid, adjacent marker points 
in the same column of the rectangular grid, and adjacent 
marker points disposed diagonally in the rectangular 
grid; 

(c) determining one or more 3D strains surrounding each 

30 marker point; 

(cl) generating a two-dimensional (2D) plane tangent to 
the body skin at each marker point by averaging normal 
vectors to the planes between each neighboring pair of 
strain vectors associated with the corresponding marker 

35 point, wherein a neighboring pair of strain vectors com- 
prises strain vectors associated with two closest neigh- 
bor marker points that are adjacent to one another; 

(d) projecting the 3D strains surrounding each marker 
point onto the corresponding 2D plane; 

40 (e) after projecting the 3D strains onto the 2D tangential 

plane for each marker point, rotating the projected 
strains in pairs onto axes defined with respect to the 
corresponding marker point; 

(1) averaging the rotated pairs for each axis associated with 

45 each marker point to generate a longitudinal strain value 

(e ), a circumferential strain value (e x ), and a shear strain 
value (e ) for the marker point; 

(g) determining principle strain values (e 7 and 6//) for each 
marker point using eigenvector analysis; 

50 (h) if the principle strain values associated with a marker 

point have opposite signs, using the principle strain val- 
ues to determine an angle of a line of non-extension for 
the marker point; and 

(i) if the principle strain values associated with a marker 

55 point have a common sign, recording an angle of mini- 
mum extension or an angle of minimum compression for 
the marker point. 

18 . The method of claim 17 wherein obtaining position 
data comprises obtaining 3D positions of the marker points 

60 with the joint of the test subject in positions other than the 
initial position and the deformed position. 

19 . The method of claim 17 wherein determining one or 
more 3D strains surrounding each marker point comprises 
computing one or more second order Lagrangian strains. 

65 20 . The method of claim 17 wherein generating a 2D plane 

tangent to the body skin at each marker point includes aver- 
aging eight normal vectors for each marker point. 
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17 

21. The method of claim 17 wherein using the principle 
strains associated with a marker point to determine the angle 
of a line of non-extension for the marker point comprises 
using the principle strains to mathematically determine the 
angle of the line of non-extension using the equations: 5 


tan 2 0 - 


s >(2 + £>) 
-e„(2 + s„) 


tan 2 0 = 


(1 ~ £ i) 2 ( £ i(2 + £i)) 

a +e „fa-a+ £ „) 2 ) 


to 


wherein the equations correspond to the angle between a 
primary eigenvector and the line of non-extension projected 
onto the initial position and the deformed position, respec- 
tively, wherein e 7 and e 77 are the principle strains. 

22. The method of claim 17 further comprising projecting 
the angle of minimum extension or the angle of minimum 
compression for the marker point onto the body skin. 



